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Background: Students' perceptions of the educational environment are an important construct in assessing 
and enhancing the quality of medical training programs. Reliable and valid measurement, however, can 
be problematic - especially as instruments developed and tested in one culture are translated for use in 
another. 

Materials and method: This study sought to explore the psychometric properties of the Postgraduate Hospital 
Educational Environment Measure (PHEEM) for use in an Iranian hospital training setting. We translated 
the instrument into Persian and ensured its content validity by back translation and expert review prior to 
administering it to 127 residents of Urmia University of Medical Science. 

Results: Overall internal consistency of the translated measure was good (a =0.94). Principal components 
analysis revealed five factors accounting for 52.8% of the variance. 

Conclusion: The Persian version of the PHEEM appears to be a reliable and potentially valid instrument for 
use in Iranian medical schools and may find favor in evaluating the educational environments of residency 
programs nationwide. 
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Since knowledge, thinking, and learning are context 
dependent (1), it is important to acknowledge the 
relationship between students' educational environ- 
ment and their academic achievement and satisfaction 

(2) . Clinical education, in particular, is an environment 
with unique challenges and an effective clinical teaching 
environment balances and integrates the relevancy of 
professional education to patients as well as students' 
active participation, professional thinking, and behaviors 

(3) . Assessing the quality of the clinical learning envi- 
ronment, then, should be done periodically. However, 
the reliability and validity of the resulting scores should 
first be established in the setting the instrument is to be 
used. 

The Postgraduate Hospital Educational Environ- 
ment Measure (PHEEM) was developed and validated 



in Scotland and the West Midlands using grounded 
theory and Delphi methods (4). 

PHEEM is a 40-item questionnaire with three sub- 
scales tapping respondents' perceptions of: 1) role autonomy; 
2) teaching; and 3) social support. Each item is measured on 
a five-point Likert-type scale, and is scored: 4 for 'Strongly 
Agree', 3 for 'Agree', 2 for 'Uncertain', 1 for 'Disagree', and 
0 for 'Strongly Disagree' (four items are reverse-coded prior 
to scoring). Total scores range from 0 to 160, with higher 
scores indicating a higher quality educational climate (4). 

While researchers in different countries have success- 
fully translated and analyzed the psychometric features of 
the PHEEM (3, 5-10), its validity in an Iranian training 
context is unknown. Thus, this study assesses the psycho- 
metric properties of Persian (Farsi) version of the PHEEM 
in an Iranian residency program setting. 
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Methods 

After garnering the author's permission to adapt the 
PHEEM, an Iranian physician proficient in Enghsh 
translated the instrument into Persian. We then sent the 
translated version to six reviewers (three clinical teachers 
and three medical education experts) who were asked to 
assess item relevance for Iranian residency programs. 
Based on their comments, we made minor modifications 
to several items. To make the wording more appropriate 
in an Iranian context, item #7 was changed from There 
is racism in this post to Discrimination exists here and item 
#17 was changed from My hours conform to the New 
Deal to My working hours are in line with official rules of 
my country. The edited questionnaire was then back- 
translated to English by a professional translator, who was 
blinded to the original version. Another translator sub- 
sequently reviewed the back-translated version along- 
side the original questionnaire and found no conceptual 
differences. Finally, 35 randomly selected residents in 
Urmia University of Medical Sciences completed the 
Persian version to assess its face validity and reliabiUty. 
Spaces for written suggestions were provided after each 
item; however, no comments were made regarding item 
exclusion or obscurity. 

The pre-tested questionnaire was then administered to 
1 70 residents of the university. Construct vahdity of the 
scores was assessed using a principal components analysis 
(PCA) and a Varimax rotation. We considered eigenva- 
lues > 1.6 and factor loadings >0.3; a visual inspection 
of the inflection point in the scree plot dictated the factor 
extraction criteria. All analyses were conducted using 
SPSS Version 16.0 (11), and a critical p-value of <0.05 
was set for all inferential analyses. 

Results 

One hundred and twenty-eight (128) residents from seven 
clinical departments (anesthesiology, cardiology, inter- 
nal medicine, surgery, obstetrics and gynecology, pathol- 
ogy, and pediatrics) returned completed questionnaires. 



The corrected response rate was 74.7% (one returned 
instrument with < 50% of items completed was excluded 
from the study). Participants consisted of 52 women and 
75 men, with a mean age of 33 years. Per the origi- 
nal subscales, the internal consistency (Cronbach's a) 
was 0.94 for 40 items and 0.84, 0.90, and 0.80 for the 
role autonomy, teaching, and social support subscales, 
respectively. 

A PCA of residents' responses revealed five factors 
with eigenvalues >1.6, accounting for 52.8% of total 
variance. Items loading on multiple factors were assigned 
based on the largest coefficient. Extracted factors were 
identified by two researchers (Table 1). 

As shown in Table 1, 8 of 1 1 items (in italics) loading on 
Factor 1, 'Teaching', were part of the 'Perception of 
Teaching' subscale of the original questionnaire. Four 
of seven items loaded similarly on 'Social Support'. 
A summary of factor loadings >0.30 is presented in 
Table 1. 

Discussion 

Our psychometric analysis of the Persian version of the 
PHEEM is encouraging. In the assessment by a group of 
experts (clinical teachers and medical educators), the 
instrument showed acceptable content validity, with only 
two items (items 7 and 1 7) requiring changes for use in an 
Iranian hospital setting. In pretesting with residents, the 
instrument also had suitable face vahdity. Regarding 
construct validity, the PCA revealed a multi-dimensional 
structure. The loading of items related to clinical teaching 
quality in the first factor reflects residents' perceptions of 
the educational environment. Both the original and the 
revised instruments showed good internal consistency 
across the representative subscales. Numerous studies, in 
accordance with our own, have reported high internal 
consistency for the PHEEM (3, 5-10). Our PCA results 
are similar to a Chilean study (9), in which the PHEEM 
was also found to tap five unique factors. Conversely, our 



Table 1. Comparison of factors extracted in the study and the original questionnaire 





Factor 


Name 


Items 


Cronbach's a 


Study subscales 


1 


Teaching 


10, 15, 22, 28, 30, 31, 33, 35, 37, 39, 40 


0.88 




2 


Education system 


1, 2, 3, 4, 6, 9, 14, 21, 23 


0.84 




3 


Training facilities 


17, 20, 26, 27, 32, 38 


0.78 




4 


Job satisfaction 


12, 16, 18, 19, 29, 34, 36 


0.79 




5 


Social support 


5, 7*, 8*, 11*, 13', 24, 25 


0.74 


Original subscales 


1 


Perception of role autonomy 


1, 4, 5, 8*, 9, 11*, 14, 17, 18, 29, 30, 32, 34, 40 


0.84 




2 


Perception of teaching 


2, 3, 6, 10, 12, 15, 21, 22, 23, 27, 28, 31, 33, 37, 39 


0.90 




3 


Perception of social support 


7*, 73*, 16, 19, 20, 24, 25, 26, 35, 36, 38 


0.80 



*ltems reverse-coded prior to scoring. 

Note: Persian version of the questionnaire can be accessed at: http://etums.tums.ac. ir/Default.aspx?PagelD=1 66. 
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results are disparate with studies showing the PHEEM to 
have a unidimensional factor structure (5, 6, 8-10). 

Comparing the results of this study with the original 
questionnaire shows that most of 'perception of role 
autonomy' items in the original work loaded on three 
factors of our study: 'education system', 'training facility' 
and 'job satisfaction'. Conversely, only four items of 
the original instrument's social support subscale loaded 
on our social support factor, with the remaining seven 
distributed to other factors. As the nature of knowledge, 
thinking, and learning is context specific, the cultural 
and educational system differences may have caused 
'role autonomy' to be perceived as three separate dimen- 
sions. These contextual considerations may also underlie 
observed differences in the social support factor. 

Conclusion 

The Persian (Farsi) version of the PHEEM shows promise 
as a rehable and potentially valid instrument for assessing 
the clinical educational environment in this context. 
We recommend expanded study of this instrument perhaps 
in combination with qualitative approaches to identify 
factors affecting differences in group perceptions of the 
educational environment. 

Acknowledgements 

This research paper would not have been possible without the 
support of Ms. Sue Roff. The authors wish to express their 
appreciation to her valuable comments. 

Conflict of interests and funding 

This study is based on the MSc dissertation of the first 
author. The authors declare no conflict of interests. 



References 



1. Burning SJ, Artino AR. Situativity theory: a perspective on liow 
participants and the environment can interact: AMEE Guide 
no. 52. Med Teach 2011; 33: 188-99. 

2. Soemantri D, Herrera C, Riquelme A. Measuring the educa- 
tional environment in health professions studies: a systematic 
review. Med Teach 2010; 32: 947-52. 

3. Clapham M, Wall D, Batchelor A. Educational environment in 
intensive care medicine-use of postgraduate hospital educa- 
tional environment measure (PHEEM). Med Teach 2007; 29: 
el84-e91. 

4. Roff S, McAleer S, Skinner A. Development and validation of 
an instrument to measure the postgraduate clinical learning and 
teaching educational environment for hospital-based junior 
doctors in the UK. Med Teach 2005; 27: 326-31. 

5. Aspegren K, Bastholt L, Bested K, Bonnesen T, Ejlersen E, 
Fog I, et al. Validation of the PHEEM instrument in a Danish 
hospital setting. Med Teach 2007; 29: 504-6. English. 

6. Boor K, Scheele F, Van Der Vleuten C, Scherpbier A, 
Teunissen P, Sijtsma K. Psychometric properties of an instru- 
ment to measure the clinical learning environment. Med Educ 
2007; 41: 92-9. 

7. Gooneratne I, Munasinghe S, Siriwardena C, Olupeliyawa A, 
Karunathilake I. Assessment of psychometric properties of a 
modified PHEEM questionnaire. Ann Acad of Med Singapore 
2008; 37: 993-7. Enghsh. 

8. Pinnock R, Reed P, Wright M. The learning environment of 
paediatric trainees in New Zealand. J Paediatric Child Health 
2009; 45: 529-34. English. 

9. Riquelme A, Herrera C, Aranis C, Oporto J, Padilla O. 
Psychometric analyses and internal consistency of the PHEEM 
questionnaire to measure the clinical learning environment in 
the clerkship of a Medical School in Chile. Med Teach 2009; 31: 
e221-e5. 

10. Vieira JE. The postgraduate hospital educational environment 
measure (PHEEM) questionnaire identifies quality of instruc- 
tion as a key factor predicting academic achievement. Clinics 
2008; 63: 741-6. 

11. SPSS Inc. Released 2007. SPSS for Windows, Version 16.0. 
Chicago: SPSS Inc. 



Citation: IVIed Educ Online 2014, 19: 24546 - http://dx.doi.org/10.3402/meo.v19.24546 



3 

(page number not for citation purpose) 



